Impact Study of Nonverbal Facial Cues on Spontaneous Chatting with Virtual Humans

نویسندگان

  • Stéphane Gobron
  • Junghyun Ahn
  • Daniel Thalmann
  • Marcin Skowron
  • Arvid Kappas
چکیده

Non-verbal communication (NVC) is considered to represent more than 90 percent of everyday communication. In virtual world, this important aspect of interaction between virtual humans (VH) is strongly neglected. This paper presents a user-test study to demonstrate the impact of automatically generated graphics-based NVC expression on the dialog quality: first, we wanted to compare impassive and emotion facial expression simulation for impact on the chatting. Second, we wanted to see whether people like chatting within a 3D graphical environment. Our model only proposes facial expressions and head movements induced from spontaneous chatting between VHs. Only subtle facial expressions are being used as nonverbal cues –i.e. related to the emotional model. Motion capture animations related to hand gestures, such as cleaning glasses, were randomly used to make the virtual human lively. After briefly introducing the technical architecture of the 3D-chatting system, we focus on two aspects of chatting through VHs. First, what is the influence of facial expressions that are induced from text dialog? For this purpose, we exploited an Digital Peer Publishing Licence Any party may pass on this Work by electronic means and make it available for download under the terms and conditions of the current version of the Digital Peer Publishing Licence (DPPL). The text of the licence may be accessed and retrieved via Internet at http://www.dipp.nrw.de/. emotion engine extracting an emotional content from a text and depicting it into a virtual character developed previously ([GAS+11]). Second, as our goal was not addressing automatic generation of text, we compared the impact of nonverbal cues in conversation with a chatbot or with a human operator with a wizard of oz approach. Among main results, the within group study –involving 40 subjects– suggests that subtle facial expressions impact significantly not only on the quality of experience but also on dialog understanding.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Participant responses to virtual agents in immersive virtual environments

This thesis is concerned with interaction between people and virtual humans in the context of highly immersive virtual environments (VEs). Empirical studies have shown that virtual humans (agents) with even minimal behavioural capabilities can have a significant emotional impact on participants of immer­ sive virtual environments (IVEs) to the extent that these have been used in studies of ment...

متن کامل

The Uncanny Valley and Nonverbal Communication in Virtual Characters

This chapter provides a case study of a research project investigating aspects of facial expression and viewer response to the „Uncanny Valley‟ (Mori, 1970) in realistic, human-like, virtual characters. In humans, there exists a rich variety of information that can be obtained through nonverbal communication (NVC) (Ekman, 1965). However, empirical evidence collected as part of this research pro...

متن کامل

Excercises of Style for Virtual Humans

The style of humans is a source of information about the person, her personality and enjoyment in every-day life. We wish to endow virtual characters with style of nonverbal communication. We outline the diversity in gesturing style among humans, and identify the decisive factors. We propose a computational model for defining the styled virtual characters and generate gestures accordingly. The ...

متن کامل

Pragmatic Multimodality: Effects of Nonverbal Cues of Focus and Certainty in a Virtual Human

In pragmatic multimodality, modal (pragmatic) information is conveyed multimodally by cues in gesture, facial expressions, head movements and prosody. We observed these cues in natural interaction data. They can convey positive and negative focus, in that they emphasise or de-emphasise a piece of information, and they can convey uncertainty. In this work, we test the effects on perception and r...

متن کامل

A Multimodal Nonverbal Human-robot Communication System

Socially interactive robot needs the same behaviors and capabilities of human to be accepted as a member in human society. The environment, in which this robot should operate, is the human daily life. The interaction capabilities of current robots are still limited due to complex inter-human interaction system. Humans usually use different types of verbal and nonverbal cues in their communicati...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • JVRB

دوره 10  شماره 

صفحات  -

تاریخ انتشار 2013